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To all whom it may concern: 

Be it known that, 

Takehiro NAKAJIMA 

has invented certain new and useful improvements in 

METHOD OF AND APPARATUS FOR IMAGE PROCESSING, 
IMAGE PROCESSING SYSTEM, AND IMAGE FORMING APPARATUS 



of which the following is a full, clear and exact description: 



METHOD OF AND APPARATUS FOR IMAGE PROCESSING, IMAGE 
PROCESSING SYSTEM, AND IMAGE FORMING APPARATUS 

BACKGROUND OF THE INVENTION 
5 1) Field of the Invention 

The present invention relates to a technology for creating a 
printer profile. 

2) Description of the Related Art 
10 A conventional image processing apparatus obtains a desired 

printer output by converting an input color space into an output color 
space based on a method of processing as follows: 

(1) converting color data included in image data input through a 
scanner or a monitor into the input color space based on a 

15 corresponding profile; 

(2) equally dividing the input color space using a color lookup 
table (hereinafter "LUT") recorded in the profile corresponding to a 
printer; 

(3) setting an output value at each peak of divided lattice points; 

20 and 

(4) converting the input color space into an output color space 
by obtaining the output color data using a predetermined method (e.g., 
interpolation) based on the output value stored at each peak that has a 
closest positional relation with the input color data in the divided lattice. 

25 To obtain the output color space using the above method, it is 
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required to create an appropriate printer profile. To create a printer 
profile, it is necessary to perform colorimetric processing by outputting 
a color chart including an extremely larger number of color patches than 
that of a target printer. As a result, the operation of creating the 

5 printer profile produces quite an overload. 

To cope with the problem, Japanese Patent Application Laid 
Open No. 2001-045313 discloses a technology of storing a 
compensation profile corresponding to a combination of a printing 
profile and a printer profile separately from the printing profile and the 

10 printer profile so that an increase in memory capacity is suppressed 
when data is stored, and performing a color conversion to obtain a 
color-matching proof image with a high precision. 

Japanese Patent Application Laid Open No. 2001-144976 
discloses a technology of selecting an appropriate table from a plurality 

15 of existing profiles (tables) based on evaluation using dot gain or the 
like, and creating a new profile based on the table and colorimetric data 
for a color chart having a less number of patches. 

Furthermore, Japanese Patent Application Laid Open No. 
2000-004369 discloses a technology of performing a test image display 

20 and a printer output, comparing the color of the displayed image with 
the color of the printed image, compensating a particular color that 
does not match each other by referring to a history, and storing 
corrected output values at the lattice points in an output device profile. 
Besides the above disclosures, Japanese Patent Application 

25 Laid Open No. 2001-144976 makes it possible to create a profile with a 



less number of color patches by taking the amount of dot gain as an 
evaluation standard. However, since a position of an arbitrary color on 
a recording medium is unchanged, that is, a position of creating a patch 
is fixed according to an application, a position to be measured is also 
5 the same, and even if a state of another position with no patch is 

changed, it is not possible to respond to the change. In addition, since 
a patch output at an output position is fluctuated for each representative 
color (e.g., R, G, B, C, M, Y), colors largely depend on a state of a 
printer. It is a common problem in the conventional technologies 
10 including the above example of disclosures. 

SUMMARY OF THE INVENTION 

it is an object of the present invention to solve at least the 
problems in the conventional technology. 

15 The image processing apparatus according to one aspect of the 

present invention includes a converting unit that performs color 
conversion of input data, which is color data obtained from 
measurement of a color chart of an image, a storage unit that stores the 
conversion data and history information on the measurement of the 

20 color chart, an arithmetic unit that compares the history information with 
information on the measurement of the color chart to determine number 
of color patches, and an updating unit that updates the printer profile 
based on the number of color patches. 

The image processing system according to another aspect of 

25 the present invention includes a server that updates a printer profile 



based on color data obtained from measurement of a color chart of an 
image, and a client that is connected to the server. The server 
includes a converting unit that performs color conversion of the color 
data to produce conversion data, a storage unit that stores the 
5 conversion data and history information on the measurement of the 

color chart, an arithmetic unit that compares the history information with 
information on the measurement of the color chart to determine number 
of color patches, and an updating unit that updates the printer profile 
based on the number of color patches. The client includes a profile 
10 storage unit that stores a printer profile created by the server, and a 

printer driver that converts input color data received from an application 
into output color data that can be interpreted by an image forming 
apparatus. 

The image forming apparatus according to still another aspect of 
15 the present invention includes a converting unit that performs color 
conversion of input data, which is color data obtained from 
measurement of a color chart of an image, a storage unit that stores the 
conversion data and history information on the measurement of the 
color chart, an arithmetic unit that compares the history information with 
20 information on the measurement of the color chart to determine number 
of color patches, an updating unit that updates the printer profile based 
on the number of color patches, and an image forming unit that forms a 
visible image on a medium. 

The method of image processing according to still another 
25 aspect of the present invention includes performing color conversion of 

4 

i 



input data, wherein the input data is color data obtained from 
measurement of a color chart of an image, storing the conversion data 
and history information on the measurement of the color chart, 
comparing the history information with information on the measurement 
5 of the color chart to determine number of color patches, and updating 
the printer profile based on the number of color patches. 

The computer product according to still another aspect of the 
present invention realizes the methods according to the present 
invention on a computer. 
10 The other objects, features and advantages of the present 

invention are specifically set forth in or will become apparent from the 
following detailed descriptions of the invention when read in conjunction 
with the accompanying drawings. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of an image processing apparatus 
according to an embodiment of the present invention; 

Fig. 2A and Fig. 2B illustrate how to create data to be stored in 
the history storage unit in a server; 
20 Fig. 3 illustrates how to create data to be stored in the history 

storage unit when a representative color is used; 

Fig. 4 is a flowchart of creating a color chart (patches) in which 
a number of color patches and a color region are optimized; 

Fig. 5 is a block diagram of an image forming apparatus 
25 according to an modification of the embodiment; and 
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Fig. 6 is a block diagram of a personal computer according to 
another modification of the embodiment. 

DETAILED DESCRIPTION 
5 Exemplary embodiments of a method of and an apparatus for 

image processing, image processing system, and image forming 
apparatus according to the present invention are explained in detail 
below with reference to the accompanying drawings. 

Fig. 1 is a block diagram of an image processing apparatus 

10 according to an embodiment of the present invention. The image 
processing system is constructed by connecting a server 14 (image 
processing apparatus) and a client (personal computer (PC)) 13 to a 
printer 2 through a network such as a local area network (LAN) 17. 
The server 14 performs arithmetic operation. The client 13 interfaces 

15 with a user and the printer 2. 

The server 14 includes an arithmetic unit 10, a history storage 
unit 11, a feature amount converting unit 12, a profile updating unit 15, 
and an operating system (OS) 16. The server 14 is connected with a 
measuring device 5 for color patches. 

20 The feature amount converting unit 12 stores a first LUT 202 in 

advance. The arithmetic unit 10 compares previously measured 
values of a color chart in the history storage unit 11 with newly 
measured values of a color chart, and determines a number of color 
patches from the result of comparison. 

25 The history storage unit 11 stores measured values (L, a, b) 201 
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in Lab coordinate of the past color patches and vector values 203 
obtained by compressing the three-dimensional Lab values 201 to 
one-dimensional values. This unit 11 corresponds to, for example, a 
hard disk drive (HDD) and a nonvolatile memory. 
5 The profile updating unit 15 allows the printer to output a color 

chart including the number of patches determined by the arithmetic unit 
10, re-loads the chart, updates the printer profile, and transmits the 
updated profile to the client 13. 

The operating system (OS) 16 is, for example, Microsoft 

10 Windows, UNIX, and Linux. 

The feature amount converting unit 12 represents a converting 
unit in the present invention, the arithmetic unit 10 represents an 
arithmetic unit in the present invention, and the profile updating unit 15 
represents an updating unit in the present invention. Further, the 

15 history storage unit 11 represents a storage unit in the present 
invention. 

A program for generating a C language program executed on a 
C language program generating unit is recorded in a computer-readable 
recording medium and is provided. The recording medium includes a 
20 CD-ROM, floppy disk (FD), or DVD so that the program is recorded in 
the form of an installable format file or an executable format file. 

Further, the program for generating the C language program 
may be stored on a computer connected to a network such as the 
Internet to be provided by allowing another computer to download it 
25 through the network. Alternatively, the program may be provided or 



distributed through the network. 

An image processing program operating on the server 14 of the 
embodiment is fetched from a recording medium and executed in the 
server 14 to load the program on a main storage device to thereby 

5 generate the feature amount converting unit 12, the arithmetic unit 10, 
and the profile updating unit 15 on the main storage device. 

The image processing program is recorded in CD-ROM, 
DVD-ROM, or FD in the form of an installable or executable file format, 
and is provided. Such an image processing program may be provided 

10 through a network and further be provided to the outside through the 
network in the file format. 

The client 13 includes an application 7, a profile storage unit 6, 
a printer driver 8, and an operating system (OS) 9. The client 13 is 
connected with a monitor 3 and an operator (operating unit) 4. 

15 The application 7 is, for example, a word processor or an 

application for performing spreadsheet calculation, and sends data such 
as a document created by the application 7 to the printer driver 8 using 
printing command. 

The printer driver 8 receives input color data (e.g., red (R), 

20 green (G), and blue (B)) from the application 7, converts the data to 
data in a format so that the printer 2 can interpret, and transmits the 
converted data. The data conversion is performed by referring to an 
N-dimensional LUT (N, number of dimensions of an input color space) 
in the profile stored in the profile storage unit 6 of the client 13. The 

25 N-dimensional LUT is created in the server 14, and the profile includes 



the LUTs corresponding to a number of elements of output data. In 
other words, one of the LUTs is expressed by coordinates of L, a, and b 
represented by three-dimensional Lab values, i.e., a Lab color space. 

The OS 9 is, for example, Microsoft Windows, UNIX, and Linux. 
5 The profile storage unit 6 stores a printer profile received from 

the server 14, and an HDD or a nonvolatile memory serves as the unit 
6. 

The server 14 and the client 13 according to the embodiment 
are connected with a control device such as CPU, a recording device 

10 such as HDD, a storage device such as RAM and a nonvolatile memory, 
and a communication device such as a network board, which is an 
ordinary configuration using a computer. 

The example shown in Fig. 1 has the server 14 and the client 13 
as discrete units, but one unit of personal computer may include both of 

15 the functions. Alternatively, the structure may support a so-called 

meta frame environment such that the server 14 has the application and 
the printer driver 8 and the client 13 downloads the application and 
printer driver 8 only when using them. 

Fig. 2A and Fig. 2B illustrate how to create data to be stored in 

20 the history storage unit 11 of the server 14. The history storage unit 11 
stores measured values (L, a, b) 201 in Lab coordinate of the color 
patches of the past as shown in Fig. 2A. The measured values 201 of 
the past color patches are obtained by performing arithmetic on 
three-dimensional Lab values 201 as one-dimensionally compressed 

25 vector value 203 in the arithmetic unit 10 using the first LUT 202 in the 



feature amount converting unit 12, and the vector value is stored in the 
history storage unit 11 . The first LUT 202 is a table prepared in 
advance, and is set as a reference, and therefore, this table is not 
possibly rewritten. The vector value 203 is used for determining Lab 
5 values at the time of creating patches. 

If a vector is quantized to compress vector information, the 
number B of representative vectors becomes 2° where c is a division 
number of space (a number of hierarchies in binary trees). A 
one-dimensional vector code value 2 (c ' 1) obtained by dividing the space 

10 by (c-1) times represents an average value of one-dimensional vector 
code values 2 C_1 and 2 C in a low hierarchy (divided by c times). 
Therefore, if the one-dimensional vector code value 2 (c " 1) expresses a 
blue type color, a vector code value in the low hierarchy expresses a 
bluish green type color or a bluish purple type color. 

15 As shown in Fig. 2B, each distance (or color difference) between 

Lab values 211 obtained by measuring output color patches 210 and 
Lab values of reference white (e.g., paper white) of a medium for 
printing, is obtained. At this time, a distance 212 as AE76 ("AE76 
distance") is calculated by the color difference formula according to the 

20 CIE1976Lab color system (CIE, Commission Internationale de 

L'Eclairage, International Commission on Illumination), and a distance 
213 as AE94 ("AE94 distance") is calculated by the CIE1994 color 
difference formula. Further, a difference ("distance between color 
differences") 214 between the AE76 distance and the AE94 distance is 

25 obtained to allow detailed characteristics of a target color to be 



acquired in a numerical form. Subsequently, an N-dimensional input 
vector is converted to a one-dimensional vector value 216 using a 
second conversion table LUT 215 in the feature amount converting unit 
12. At this time, the number N of dimensions of an input vector is 3 
5 (N=3) if only the AE76 distance 212, the AE94 distance 213, and the 
distance 214 between the color differences are combined. Further, 
N=6 if the Lab measured values 211 are combined to the AE76 distance 
212, the AE94 distance 213, and the distance 214 between the color 
differences. 

10 Conversion of N-dimensional data to one-dimensional data is 

performed using the first and second LUTs 202 and 215. The first and 
second LUTs 202 and 215 are prepared by using a large amount of 
sample data when the system is constructed, and include codes 
indicating values at lattice points and vector values representing the 

15 codes. For both input and output, the number of one-dimensional 

representative vectors is a number of lattice points in an N-dimensional 
cube in the profile. Assuming the number of division of a color to be 
presented is n, the number of representative vectors is n 3 . As the first 
LUT 202 is used also for creating the profile, the number of 

20 representative vectors stands at n 3 . However, in order to reduce the 
load to the server 14, it is preferred that the second LUT 215 prepare 
representative vectors created with a smaller number than n 3 (e.g., 
(n/2) 3 , (n/4) 3 ). 

A third LUT 217 (217a - • -217m) uses vectors after the vectors 
25 are expressed as neighborhoods of representative colors using the first 



LUT 202 as shown in Fig. 3. By using the vectors, even if the number 
of elements in the LUT is reduced (N > L), vector values 218a ♦ — 218m 
are obtained for L units of elements as shown in the LUT 217, thus, 
achieving high precision. That is, the third LUTs 217a • * -217m are 
5 prepared in advance for lattice points near the representative colors, 
and any of the processing 211a, 212a, 213a f 214a, • • • 211m, 212m, 
213m, and 214m corresponding to neighbor colors of the representative 
color is executed without executing the processing to all the neighbor 
colors of the representative colors as shown in Fig. 2B, and conversion 
10 may be performed using any of the LUTs 217a through 217m 

corresponding to the processing. Therefore, the processing load 
becomes lighter to obtain high speed processing. Further, as the 
range of colors is narrowed, correction with higher precision becomes 
possible. 

15 Fig. 4 is a flowchart of creating a color chart (patches) in which 

a number of color patches and a color region are optimized. 

When the color chart with the optimized number of color patches 
and color region is to be created, a color chart as a reference for 
optimizing the number of patches is output from the printer 2 (step S1), 

20 Lab values of the color patches 210 in the color chart are measured by 
a measuring device 5 (step S2). At this time, the number of patches in 
the color chart is set to the same or a smaller number of representative 
vectors in the LUT 202. The AE76 distance 212, the AE94 distance 
213, and the distance 214 between the color differences are obtained 

25 by the arithmetic unit 10 to combine them as a vector (step S3). 



When an instruction to measure only a representative color (e.g., 
R, G, B, C M, Y) is received from the user (step S4, Yes), the most 
recently measured results are loaded from the history storage unit 11 to 
extract a plurality pieces of data close to the representative vector 
5 indicating the representative color from any of the third LUTs 217a to 
217m. 

After extraction, an N-dimensional vector is converted to a 
one-dimensional vector based on the second LUT 215, and the 
one-dimensional vector is stored in the history storage unit 11 . If no 

10 instruction is received from the user (step S4, No), the N-dimensional 
vector is converted to the one-dimensional vector for the whole pieces 
of data corresponding to the whole color regions constituting the most 
recently updated profile, based on the second LUT 215, and the 
one-dimensional vectors are stored in the history storage unit 11. 

15 After storage of the data, a difference between the 

N-dimensional vector and the representative vector is calculated and 
the difference is sent to the arithmetic unit 10. Subsequently, the last 
vector value is extracted from the history storage unit 11 to determine 
the number of color patches. 

20 There are two stages for evaluation of patches created for the 

next color chart. At the first stage, an error ("A1") is compared with an 
error ("A2") (step S5). The error A1 is between the vector of the 
previously measured result and the vector of the newly measured result, 
and the error A2 is between the representative vector indicating an 

25 average value of measured values and the vector of the newly 



measured result. Specifically, A1 is the evaluation standard including 
short-term characteristics of the printer based on the values measured 
last time and this time, and A2 is the evaluation standard including 
long-term characteristics of the printer based on the average value of a 
5 large amount of samples and the value measured this time. If A1 is 
greater than A2 (step S5, No), the result of measurement the time 
before last is loaded from the history storage unit 11 to calculate a 
difference ("B1") between the result the time before last and the newly 
measured result, and the following equation is determined as the 
10 evaluation standard Ev (step S6), 
Ev=aA1+(1-a)B1. 

If A1 is smaller than A2 (step S5, Yes), the measured value 
having the smallest difference with the representative vector is loaded 
from the history storage unit 11 to calculate a difference ("B2") between 
15 the measured value and the newly measured result, and the following 
equation is determined as the evaluation standard Ev (step S7), 

Ev=aA2+(1-a)B2 

where a is a coefficient and is generally 0.5, but the coefficient can be 
varied according to the state of the printer. 

20 If the conditions of the color regions for the last time and this 

time do not match (for example, last time, patches cover the whole 
color regions, this time, patches cover only the representative color 
region), the condition for this time is preferentially selected, and lack of 
data is covered by extracting the data from the history storage unit 11 to 

25 obtain the error. 



Only when Ev as the evaluation standard is greater than a 
threshold value 01 for determination of patch output (Ev>81), the target 
Lab values are stored for patch creation (step S8). After the 
processing for determining the threshold value is finished, the Lab 
5 values for the patch creation are obtained by use of backward reference 
to the first LUT 201 to change the Lab values according to an Ev value, 
patches are randomly created and arranged in a color chart, and then 
the color chart is output from the printer 2 to measure again the patches 
(step S8 -> step S1). By randomly creating and arranging the patches 

10 in the above manner, the colors and the position of arranging the color 
patches can arbitrarily be changed, and the color patches created at the 
changed positions are measured. Therefore, any change of the color 
patches can be followed. 

When the arrangement of the color patches is fixed like in the 

15 conventional technology, change in a position with no color patches 
cannot be followed. However, by performing such processing, the 
change becomes no longer a significant matter. It is noted that the 
position of forming the color patches is set on the side closer to the 
edge part of the photoreceptor if the Ev value is small, and is set on the 

20 side closer to the central part thereof if it is great. Consequently, the 
position of forming the color patches can be set according to the Ev 
value, and a combination of the setting of the position and the change 
in the number of color patches is highly adaptable to any of the 
changes. 

25 Even if the number of color patches is to be changed, the 



position of forming the color patches is also changed, and therefore, 
any of the changes can be followed even if the position is changed not 
based on the Ev value. 

The number of patches to be created is determined at a point in 
5 time when the number of patches becomes smaller than a threshold 
value 92 of patches (step S9). After measurement and creation of the 
patches are finished, a profile creating unit creates a profile by 
weighting the evaluation-standard value Ev. The threshold value 92 is 
set by the user or set based on the threshold value 91 for determination 

10 on the patch output. 

The server 14, the client 13, and the printer 2 form the image 
processing system as shown in Fig. 1. However, as shown in Fig. 5, a 
profile updating unit 515, an arithmetic unit 510, a feature amount 
converting unit 512, an OS 516, a profile storage unit 506, a history 

15 storage unit 511, and a printer engine 502 that executes printing, can 
be formed as one unit, or can be formed as one printer 500 (image 
forming apparatus) by accommodating the components in one casing. 
In this case, the profile updating unit 515, arithmetic unit 510, feature 
amount converting unit 512, profile storage unit 506, and the history 

20 storage unit 511 have the same functions as those in the units shown in 
Fig. 1. Further, the printer 500 is connected with an operation panel 
503 and a measuring device 505. 

As shown in Fig. 6, a printer driver 608 of PC 613 may include a 
profile updating unit 615, an arithmetic unit 610, and a feature amount 

25 converting unit 612. Further, an HDD or a nonvolatile memory may 



include a profile storage unit 606 and a history storage unit 611. 

As explained above, according to the embodiment, an error at 
the time of compressing information is obtained based on the history 
information and representative vector and the new information to 
5 determine the error as an evaluation standard. It is, thereby, possible 
to control the number of patches of the color chart and create a printer 
profile with high precision. The printer profile includes short-term 
characteristics of the printer such as characteristics obtained by 
detecting the number of positions of the color patches, and long-term 
10 characteristics such as history information stored in the history storage. 
Further, the color region is divided based on Lab distances as a 
reference to enable selection of a quantitative representative color, and 
creation and correction of the profile according to the user's purpose. 

It is noted that the sequence shown in Fig. 4 can be provided as 
15 a computer program. 

As explained above, according to the present invention, it is 
possible to optimize the number of color patches when the color chart 
(patches) is measured. 

Further, by changing the number of color patches, arrangement 
20 of the patches is changed. Therefore, the position of forming the color 
patches is prevented from being fixed regardless of any applications, 
which makes it possible to adapt to the change of the printer with time. 

The present document incorporates by reference the entire 
contents of Japanese priority documents, 2002-275934 filed in Japan 
25 on September 20, 2002 and 2003-317404 filed in Japan on September 



9, 2003, 

Although the invention has been described with respect to a 
specific embodiment for a complete and clear disclosure, the appended 
claims are not to be thus limited but are to be construed as embodying 
5 all modifications and alternative constructions that may occur to one 
skilled in the art which fairly fall within the basic teaching herein set 
forth. 
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